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Abstract 

Background: The use of positive psychological interventions may be considered as a complementary strategy in 
mental health promotion and treatment. The present article constitutes a meta-analytical study of the effectiveness 
of positive psychology interventions for the general public and for individuals with specific psychosocial problems. 

Methods: We conducted a systematic literature search using PubMed, Psychlnfo, the Cochrane register, and 
manual searches. Forty articles, describing 39 studies, totaling 6,139 participants, met the criteria for inclusion. The 
outcome measures used were subjective well-being, psychological well-being and depression. Positive psychology 
interventions included self-help interventions, group training and individual therapy. 

Results: The standardized mean difference was 0.34 for subjective well-being, 0.20 for psychological well-being and 
0.23 for depression indicating small effects for positive psychology interventions. At follow-up from three to six 
months, effect sizes are small, but still significant for subjective well-being and psychological well-being, indicating 
that effects are fairly sustainable. Heterogeneity was rather high, due to the wide diversity of the studies included. 
Several variables moderated the impact on depression: Interventions were more effective if they were of longer 
duration, if recruitment was conducted via referral or hospital, if interventions were delivered to people with certain 
psychosocial problems and on an individual basis, and if the study design was of low quality. Moreover, indications 
for publication bias were found, and the quality of the studies varied considerably. 

Conclusions: The results of this meta-analysis show that positive psychology interventions can be effective in the 
enhancement of subjective well-being and psychological well-being, as well as in helping to reduce depressive 
symptoms. Additional high-quality peer-reviewed studies in diverse (clinical) populations are needed to strengthen 
the evidence-base for positive psychology interventions. 

Keywords: Well-being, Depression, Positive psychology, Interventions, Effectiveness, Randomized controlled trials, 
Meta-analysis 



Background 

Over the past few decades, many psychological treat- 
ments have been developed for common mental pro- 
blems and disorders such as depression and anxiety. 
Effectiveness has been established for cognitive behav- 
ioral therapy [1,2], problem-solving therapy [3] and 
interpersonal therapy [4]. Preventive and early interven- 
tions, such as the Coping with Depression course [5], 
the Don't Panic course [6] and Living Life to the Full 
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[7,8] are also available. The existing evidence shows that 
the mental health care system has traditionally focused 
more on treatment of mental disorders than on preven- 
tion. However, it is recognized that mental health is 
more than just the absence of mental illness, as 
expressed in the World Health Organization's definition 
of mental health: 

Mental health is a state of well-being in which the 
individual realizes his or her own abilities, can cope 
with the normal stresses of life, can work productively, 
and is able to make a contribution to his or her 
community [9]. 
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Under this definition well-being and positive function- 
ing are core elements of mental health. It underscores 
that people can be free of mental illness and at the same 
time be unhappy and exhibit a high level of dysfunction 
in daily life [10]. Likewise, people with mental disorders, 
can be happy by coping well with their illness and enjoy 
a satisfactory quality of life [11]. Subjective well-being 
refers to a cognitive and/or affective appraisal of one's 
own life as a whole [12]. Psychological well-being fo- 
cuses on the optimal functioning of the individual and 
includes concepts such as mastery, hope and purpose in 
life [13,14]. The benefits of well-being are recorded both 
in cross-sectional and longitudinal research and include 
improved productivity at work, having more meaningful 
relationships and less health care uptake [15,16]. Well- 
being is also positively associated with better physical 
health [17-19]. It is possible that this association is 
mediated by a healthy lifestyle and a healthier immune 
system, which buffers the adverse influence of stress 
[20]. In addition, the available evidence suggests that 
well-being reduces the risk of developing mental symp- 
toms and disorders [21,22] and helps reduce mortality 
risks in people with physical disease [23]. 

Seligman and Csikszentmihaly's (2000) pioneered these 
principles of positive psychology in their well-known art- 
icle entitled 'Positive psychology: An introduction! pub- 
lished in a special issue of the American Psychologist. 
They argued that a negative bias prevailed in psychology 
research, where the main focus was on negative emo- 
tions and treating mental health problems and disorders 
[24]. Although the basic concepts of well-being, happi- 
ness and human flourishing have been studied for some 
decades [12,25-27], there was a lack of evidence-based 
interventions [24]. Since the publication of Seligman and 
Csikszentmihaly's seminal article, the positive psychology 
movement has grown rapidly. The ever-expanding Inter- 
national Positive Psychology Association is among the 
most extensive research networks in the world [28] and 
many clinicians and coaches embrace the body of 
thought that positive psychology has to offer. 

Consequently, the number of evaluation studies has 
greatly increased over the past decade. Many of these 
studies demonstrated the efficacy of positive psychology 
interventions such as counting your blessings [29,30], 
practicing kindness [31], setting personal goals [32,33], 
expressing gratitude [30,34] and using personal strengths 
[30] to enhance well-being, and, in some cases, to allevi- 
ate depressive symptoms [30]. Many of these interven- 
tions are delivered in a self-help format. Sin and 
Lyubomirsky (2009) conducted a meta-analytical review 
of the evidence for the effectiveness of positive psych- 
ology interventions (PPIs). Their results show that PPIs 
can indeed be effective in enhancing well-being (r = 0.29, 
standardized mean difference Cohen's d = 0.61) and 



help to reduce depressive symptom levels in clinical 
populations (r = 0.31, Cohen's d = 0.65). However, this 
meta-analysis had some important limitations. First, 
the meta-analysis included both randomized studies 
and quasi-experimental studies. Second, study quality 
was not addressed as a potential effect moderator. In 
recent meta-analyses, it has been shown that the treat- 
ment effects of psychotherapy have been overestimated 
in lower quality studies [35,36]. The lack of clarity in 
the inclusion criteria constitutes a third limitation. 
Intervention studies, although related to positive 
psychology but not strictly developed within this new 
framework (e.g. mindfulness, life-review) were included 
in the meta-analysis. However, inclusion of these studies 
reduces the robustness of the results for pure positive 
psychology interventions. 

Present study 

The aim of the present study is to conduct a meta- 
analysis of the effects of specific positive psychology 
interventions in the general public and in people with 
specific psychosocial problems. Subjective well-being, 
psychological well-being and depressive symptoms were 
the outcome measures. Potential variables moderating 
the effectiveness of the interventions, such as interven- 
tion type, duration and quality of the research design, 
were also examined. This study will add to the existing 
literature and the above meta-analytical review [37] by 
1) only including randomized controlled studies, 2) tak- 
ing the methodological quality of the primary studies 
into account, 3) including the most recent studies (2009 
- 2012), 4) analyzing not only post-test effects but also 
long-term effects at follow up, and 5) applying clear in- 
clusion criteria for the type of interventions and study 
design. 

Method 

Search strategy 

A systematic literature search was carried out in Psy- 
chlnfo, PubMed and the Cochrane Central Register of 
Controlled Trials, covering the period from 1998 (the 
start of the positive psychology movement) to November 
2012. The search strategy was based on two key compo- 
nents: there should be a) a specific positive psychology 
intervention, and b) an outcome evaluation. The follow- 
ing MeSH terms and text words were used: "well-being" 
or "happiness" or "happy*", "optimism", "positive psych- 
ology" in combination with "intervention", "treatment", 
"therapy" and "prevention". This was combined with 
terms related to outcome research: "effect*", or "effic*", 
or "outcome*", or "evaluat*". We also cross-checked the 
references from the studies retrieved, the earlier meta- 
analysis of Sin & Lyubomirsky (2009) and two other 
reviews of positive psychological interventions [38,39]. 
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The search was restricted to peer-reviewed studies in the 
English language. 

Selection of studies 

Two reviewers (LB and MH) independently selected po- 
tentially eligible studies in two phases. At the first phase, 
selection was based on title and abstract, and at the sec- 
ond phase on the full-text article. All studies identified 
as potentially eligible by at least one of the reviewers 
during the first selection phase, were re-assessed at the 
second selection phase. During the second phase, dis- 
agreements between the reviewers were resolved by con- 
sensus. The inter-rater reliability (kappa) was 0.90. 
The inclusion criteria were as follows: 

• Examination of the effects of a positive psychology 
intervention. A positive psychology intervention 
(PPI) was defined in accordance with Sin and 
Lyubomirsky's (2009) article as a psychological 
intervention (training, exercise, therapy) primarily 
aimed at raising positive feelings, positive cognitions 
or positive behavior as opposed to interventions 
aiming to reduce symptoms, problems or disorders. 
The intervention should have been explicitly 
developed in line with the theoretical tradition of 
positive psychology (usually reported in the 
introduction section of an article). 

• Randomization of the study subjects (randomizing 
individuals, not groups) and the presence of a 
comparator condition (no intervention, placebo, care 
as usual). 

• Publication in a peer-reviewed journal. 

• At least one of the following are measured as 
outcomes: well-being (subjective well-being and/or 
psychological well-being) or depression (diagnosis or 
symptoms). 

• Sufficient statistics are reported to enable the 
calculation of standardized effect sizes. 

If necessary, authors were contacted for supplementary 
data. We excluded studies that involved physical exer- 
cises aimed at the improvement of well-being, as well as 
mindfulness or meditation interventions, forgiveness 
therapy, life-review and reminiscence interventions. Fur- 
thermore, well-being interventions in diseased popula- 
tions not explicitly grounded in positive psychology 
theory ('coping with disease courses') were excluded. 
Apart from being beyond the scope of this meta-analysis, 
extensive meta-analyses have already been published for 
these types of intervention [40-42]. This does not imply 
that these interventions do not have positive effects on 
well-being, a point which will be elaborated on in the 
discussion section of this paper. 



Data extraction 

Data extraction and study quality assessment were per- 
formed by one reviewer (LB) and independently checked 
by a second reviewer (MH). Disagreements were 
resolved by consensus. Data were collected on design, 
intervention characteristics, target group, recruitment 
methods, delivery mode, number of sessions, attrition 
rates, control group, outcome measures and effect sizes 
(post- test and at follow up of at least 3 months). The 
primary outcomes in our meta-analysis were subjective 
well-being (SWB), psychological well-being (PWB) and 
depressive symptoms/depression. 

The methodological quality of the included studies 
was assessed using a short scale of six criteria tai- 
lored to those studies and based on criteria established 
by the Cochrane collaboration [43]: 1) Adequacy of 
randomization concealment, 2) Blinding of subjects to 
the condition (blinding of assessors was not applicable 
in most cases), 3) Baseline comparability: were study 
groups comparable at the beginning of the study and 
was this explicitly assessed? (Or were adjustments made 
to correct for baseline imbalance using appropriate cov- 
ariates), 4) Power analysis: is there an adequate power 
analysis and/or are there at least 50 participants in the 
analysis?, 5) Completeness of follow up data: clear attri- 
tion analysis and loss to follow up < 50%, 6) Handling of 
missing data: the use of intention-to-treat analysis (as 
opposed to a completers-only analysis). Each criterion 
was rated as 0 (study does not meet criterion) or 1 
(study meets criterion). The inter-rater reliability (kappa) 
was 0.91. The quality of a study was assessed as high 
when five or six criteria were met, medium when three 
or four criteria were met, and low when zero, one or 
two criteria were met. Along with a summary score, the 
aspects relating to quality were also considered individu- 
ally, as results based on composite quality scales can be 
equivocal [44]. Table 1 shows the quality assessment for 
each study. The quality of the studies was scored from 1 
to 5 (M = 2.56; SD = 1.25). Twenty studies were rated 
as low, 18 were of medium quality and one study was 
of high quality. None of the studies met all quality cri- 
teria. The average number of participants in the ana- 
lysis was rather high (17 out of 39 studies scored 
positive on this criterion), although none of the studies 
reported an adequate power analysis. Also, baseline 
comparability was frequently reported (26/39 studies). 
On the other hand, independence in the randomization 
procedure was seldom reported (7/39 studies) and an 
intention-to-treat analysis was rarely conducted (3/39 
studies). 

Meta-analysis 

In a meta-analysis, the effects found in the primary studies 
are converted into a standardized effect size, which is no 



Bolier et al. BMC Public Health 201 3, 13:1 1 9 
http://www.biomedcentral.com/1471-2458/13/119 



Page 4 of 20 



Table 1 Quality assessment per study 



Study 


1 


2 


3 


4 5 


6 


Total 


Abbott 2009 [78] 


0 


0 


1 


1 0 


1 


3 


Boehm 201 1 [73] 


0 


1 


1 


1 0 


1 


4 


Buchanan 2010 [56] 


0 


0 


0 


1 0 


0 


1 


Burton 2004 [64] 


0 


1 


1 


1 1 


0 


4 


Cheavens 2006 [76] 


0 


0 


1 


0 1 


0 


2 


Emmons 2006 study 1 


0 


1 


0 


1 0 


0 


2 


Emmons 2006 study 3 


0 


1 


0 


1 0 


0 


2 


Fava 1 998 [82] 


0 


1 


0 


0 1 


0 


2 


Fava 2005 [83] 


0 


1 


0 


0 0 


0 


1 


Feldman 2012 [60] 


0 


0 


0 


1 0 


0 


1 


Frieswijk 2005 


0 


0 


0 


1 0 


0 


1 


Gander 2012 [74] 


0 


1 


1 


1 0 


0 


3 


Goldstein 2007 [84] 


0 


0 




1 0 


0 


1 


Grant 2009 [79] 


0 


0 




0 0 


0 


0 


Grant 2012 [82] 


1 


1 


1 


1 0 


0 


4 


Green 2006 [33] 


0 


0 




1 1 


0 


2 


Hurley 2012 [61] 


0 


0 


1 


1 0 


0 


2 


King 2001 [66] 


0 


1 




0 1 


0 


2 


Kremers 2006 [57] 


0 


0 


! 


1 1 


0 


3 


Layous 2012 [75] 


0 


1 


1 


1 0 


0 


3 


Lichter 1 980 study 2 [80] 


0 


0 




0 1 


0 


1 


Luthans 2008 [65] 


1 


1 


1 


1 0 


0 


4 


Luthans 2010 study 1 [72] 


0 


1 


1 


1 1 


0 


A 


Lyubomirsky 2006 study 2 [58] 


0 


1 




1 1 


0 


A 


Lyubomirsky 201 1 [67] 


0 


1 


, 


1 0 


0 


3 


Martinez 2010 [68] 


0 


1 


1 


1 1 


0 


4 


Mitchell 2009 [69] 


1 


1 


1 


1 0 


1 


5 


Page 2012 [62] 


1 


0 


1 


0 0 


0 


2 


Peters 2010 [70] 


0 


1 


1 


1 1 


0 


A 


Quoidbach 2009 [59] 


1 


0 


, 


0 0 


0 


2 


Schueller 2012 [63] 


1 


0 


1 


1 0 


0 


3 


Seligman 2005 [30] 


0 


1 


1 


1 1 


0 


A 


Seligman 2006 study 1 [51] 


0 


0 


1 


0 0 


0 


1 


Seligman 2006 study 2 [51] 


0 


1 




0 1 


0 


3 


Shapira 2010 [55]; Mongrain 2011 [53]; Sergeant 2011 [54]; Mongrain 2012 [52] 


1 


1 




1 0 


0 


4 


Sheldon 2002 [32] 


0 


1 




1 1 


0 


A 


Sheldon 2006 [34] 


0 


1 




0 0 


0 


2 


Spence 2007 [81] 


0 


0 




0 0 


0 


1 


Wing 2006 [71] 


0 


1 


0 


1 0 


0 


2 


Total 


7 


23 


26 


27 14 


3 


100 



Index: 

1 = Randomization concealment. 

2 = Blinding of subjects. 

3 = Baseline comparability. 

4 = Power analysis or N>=50. 

5 = Completeness of follow up data. 

6 = Intention-to-treat analysis. 
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longer placed on the original measurement scale, and can 
therefore be compared with measures from other scales. 
For each study, we calculated effect sizes (Cohen's d) by 
subtracting the average score of the experimental group 
(Me) from the average score of the control group (Mc), 
and dividing the result by the pooled standard deviations 
of both groups. This was done at post-test because 
randomization usually results in comparable groups across 
conditions at baseline. However, if baseline differences on 
outcome variables did exist despite the randomization, d's 
were calculated on the basis of pre- post-test differences: by 
calculating the standardized pre- post change score for the 
experimental group (de) and the control group (dc) and 
subsequendy calculating their difference as Ad= de - dc. 
For example, an effect size of 0.5 indicates that the mean 
of the experimental group is half a standard unit (stand- 
ard deviation) larger than the mean of the control group. 
From a clinical perspective, effect sizes of 0.56 - 1.2 can be 
interpreted as large, while effect sizes of 0.33 - 0.55 are of 
medium size, and effects of 0 - 0.32 are small [45] . 

In the calculation of effect sizes for depression, we 
used instruments that explicitly measure depression (e.g. 
the Beck Depression Inventory, or the Center for Epi- 
demiological Studies Depression Scale). For subjective 
and psychological well-being, we also used instruments 
related to the construct of well-being (such as positive 
affect for SWB and hope for PWB). If more than one 
measure was used for SWB, PWB or depression, the 
mean of the effect sizes was calculated, so that each 
study outcome had one effect size. If more than one ex- 
perimental group was compared with a control condi- 
tion in a particular study, the number of subjects in the 
control groups was evenly divided across the experimen- 
tal groups so that each subject was used only once in 
the meta-analysis. 

To calculate pooled mean effect sizes, we used Com- 
prehensive Meta-Analysis (CMA, Version 2.2.064). Due 
to the diversity of studies and populations, a common 
effect size was not assumed and we expected consider- 
able heterogeneity. Therefore, it was decided a priori to 
use the 'random effects model'. Effect sizes may differ 
under this model, not only because of random error 
within studies (as in the fixed effects model), but also as 
a result of true variation in effect sizes between studies. 
The outcomes of the random effects model are conserva- 
tive in that their 95% Confidence Intervals (CIs) are often 
broad, thus reducing the likelihood of type-II errors. 

We tested for the presence of heterogeneity with 
two indicators. First, we calculated the Q-statistic. A 
significant Q rejects the null-hypothesis of homogen- 
eity and indicates that the true effect size probably 
does vary from study to study. Second, the I 2 -statistic 
was calculated. This is a percentage indicating the 
study-to-study dispersion due to real differences, over 



and above random sampling error. A value of 0% 
indicates an absence of dispersion, and larger values 
show increasing levels of heterogeneity where 25% 
can be considered as low, 50% as moderate and 75% 
as a high level of heterogeneity [46]. 

Owing to the expected high level of heterogeneity, 
all studies were taken into account. Outliers were 
considered, but not automatically removed from the 
meta-analysis. The procedure of removing outliers 
which are outside the confidence interval of the 
pooled effect size is advised when a common effect 
size is assumed. However, in our meta-analysis, high 
dispersion was expected and therefore only the exclu- 
sion of Cohen's d > 2.5 from the final sample was 
planned. 

Subgroup analyses were performed by testing differ- 
ences in Cohen's d's between subgroups. Six potential 
moderators were determined based on previous re- 
search and the characteristics of the investigated inter- 
ventions and studies: 1) Self-selected sample/not self- 
selected: did the participants know that the aim of the 
intervention was to make them feel better?; 2) Dur- 
ation: less than four weeks, four to eight weeks, or 
more than eight weeks; 3) Type of intervention: self- 
help, group intervention, or individual therapy; 4) Re- 
cruitment method: community (in a community center, 
local newspapers), internet, by referral/hospital, at uni- 
versity; 5) Psychosocial problems (Yes/none): was the 
data based on a group with certain psychosocial pro- 
blems or was the study open to everyone?; 6) Quality 
rating: low (score 1 or 2), medium (score 3 or 4) or 
high (score 5 or 6). The impact of the duration and 
quality ratings was also assessed using meta-regression. 

Results of meta-analysis may be biased due to the fact 
that studies with non-significant or negative results are 
less likely to be published in peer-reviewed journals 
[47]. In order to address this issue, we used three indi- 
ces: funnel plots, the Orwin's fail-safe number and the 
Trim and Fill method. A funnel plot is a graph of effect 
size against study size. When publication bias is absent, 
the observed studies are expected to be distributed sym- 
metrically around the pooled effect size. The Orwin's 
fail-safe number indicates the number of non- 
significant unpublished studies needed to reduce the 
overall significant effect to non-significance (according 
to a self-stated criterium) [48]. The effect size can be 
considered to be robust if the number of studies 
required to reduce the overall effect size to a non- 
significant level exceeds 5 K + 10, where K is the num- 
ber of studies included. If asymmetry is found in the 
funnel plot, the Trim and Fill method adjusts the pooled 
effect size for the outcomes of missing studies [49]. Im- 
puting missing studies restores the symmetry in the fun- 
nel plot and an adjusted effect size can be calculated. 
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For the reporting of the results of this meta-analysis, 
we applied Preferred Reporting Items for Systematic 
Reviews and Meta-Analyses (PRISMA) guidelines [50]. 

Results 

Description of studies 

The selection process is illustrated in Figure 1. First, 5,335 
titles were retrieved from databases and 55 titles were 
identified through searching the reference list accompany- 
ing the meta-analysis by Sin and Lyubomirsky (2009) [37] 
as well as two other literature reviews of positive psycho- 
logical interventions [38,39]. After reviewing the titles and 
abstracts and removing duplicates, 84 articles were identi- 
fied as being potentially eligible for inclusion in our study. 
Of these 84 articles, 40 articles in which 39 studies were 
described, met our inclusion criteria (of these, 17 articles 
describing 19 studies were also included in the meta- 
analysis by Sin and Lyubomirsky, 2009). In two articles 



[29,51] two studies were described, and one study [52-55] 
was published in four articles. 

The characteristics of the studies included are described 
in Table 2. The studies evaluated 6,139 subjects, 4,043 in 
PPI groups and 2,096 in control groups. Ten studies 
compared a PPI with a no-intervention control group 
[29,51,56-63], 17 studies compared a PPI with a placebo 
intervention [29,30,32,34,52-55,64-75], seven studies with 
a waiting list control group [33,76-81] and five studies 
with another active intervention (care as usual) [51,82-85]. 
A minority of seven studies [51,57,76,77,82,83] applied in- 
clusion criteria to target a specific group with psychosocial 
problems such as depression and anxiety symptoms. Half 
of the studies, 19 in total, recruited the subjects (not ne- 
cessarily students) through university [29,32,34,51,56,58- 
61,64-68,70,72,75,80,85]. In seven studies subjects were 
recruited in the community [33,57,71,73,76,77,81], in four 
studies by referral from a practitioner or hospital 
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Records identified through database 
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(Psychlnfo = 2,922, PubMed 2,207, 
Cochrane 206 = 5,335 titles 
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Full-text articles assessed 
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(n = 84) 



Full-text articles excluded 
(n = 44) 
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appropriate: no randomization, 
no control group (27 studies) 

. intervention did not meet the 
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(1 study) 
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data extraction (1 study) 
no appropriate outcome 
measures in accordance with 
the criteria (1 study) 



Figure 1 Flow diagram. 



Articles included in meta- 
analysis 
n = 40 (= 39 studies) 



Table 2 Characteristics of randomized controlled trials examining the effects of positive psychology interventions 

Author Intervention Session Mean age Delivery Recruitment Self- Psychosocial problems / Control 

(number), (range or selection inclusion criteria Group 

duration SD) 



N 

analyzed 

(post 

test) 



Attrition Outcome Follow-up 
rate, % measures (min. 
(post test) 3 months) 



° S 

CL C 

n 2 

"> ? 

* §: 

O 5 

3 NJ 

o 



Abbott 2009 ResilienceOnline 

[78] 



Boehm2011 Optimism and 

[73] 



7, 10w 



6, 6w 



Buchanan 
2010 [56] 



gratitude exercise 
Doing acts of kindness 10, 1 0d 



Burton 2004 Writing about positive 3, 3d 



ft.- -1 



Cheavens 
2006 [76] 



experiences 



Hope therapy 



8, 8w 



Emmons Practising gratitude by 10, lOw 
2006 study 1 counting one's 
[29] blessings 



Emmons Practising gratitude by 21, 3w 
2006 study 3 counting one's 
[29] blessings 



Fava 
[82] 



998 Well-being therapy 



Fava 2005 Well-being therapy 

[83] 



Feldman Hopeful goal-directed 1, Id 

2012 [60] thinking 

Frieswijk Self-management 5, lOw 

2005 [77] positive bibliotherapy 



43 



Self-help Organization Self- 
selected 



35.6(114) Self-help Community Self- 
selected 



U Self-help University 

(students) 



49 (22-77) Self-help Referral/ 
hospita 



16w 284(6.5) Individual Referral/ 

hospita 



16w 41.9(12) Individual Referral/ 

hospita 



18.7 (18- Group University 
22) 

72.9 (6.2) Self-help Community 



Self- 
selected 



26(18-60) Self-help University 

College- Self-help University 
based 
sample 
1 8.6 (0.95) 

49 (32-64) Group Community Self- 
selected 



Not self- 
selected 

Self- 
selected 



None 

None 
None 



Not self- None 
selected 



Waiting list 



Placebo 
No 

intervention 
Placebo 



Inclusion criteria unclear Waiting list 



Not self- None 
selected 



Not self- None 
selected 



Placebo 



Ne=26 
Nc=27 



Ne=146 
Nc=74 

Ne=28 
Nc=28 

Ne=48 
Nc=42 



Ne=17 
Nc=15 



Ne=65 
Nc=67 



No Ne=33 
intervention Nc=32 



Self- Diagnosis of MDD or AD, TAU 
selected succesful response to 
treatment 



Self- Diagnosis of GAD 
selected 



TAU 



Ne=10 
Nc=10 



Ne=8 
Nc=8 



None 



No Ne=37 
intervention Nc=29 



Slightly or moderately frail Waiting list Ne=79 
(>=65 GFI) Nc=86 



41.5% PWB:AHI 
DEP: 
DASS-21 

? SWB: SWLS 



0% (? nr) SWB: SWLS 



0% SWB: PA 



1 2% PWB: SHS - 

22% DEP: CES- 

T: 1 8% D 

T: 4% SWB: Life - 

as a 
whole, 
upcoming 
week, PA 

0% (? nr) SWB: Life - 
as a 
whole, 
upcoming 
week, PA 
(self-report 
and 

observed) 

0% PWB: 

RPWB DEP: 
CID, SQ 
subscale 

20% PWB: 1 yr (not in 

RPWB DEP: study) 
CID, SQ 
subscale 

24.7% PWB: 

GSHS, PIL 

1 8.4% SWB: SPF- 6 m 

10.4%> ILPWB: 
T: 14.5% MS 



Self-help 



None 



Placebo 



74% 



6 m 



Table 2 Characteristics of randomized controlled trials examining the effects of positive psychology interventions (Continued) 



Gander 2012 9 exercises: gratitude 7, 1w 14, 
[74] visit three good things 2w 

(1 and 2 weeks), 
strengths, three funny 
things, social exercises 

Goldstein Cultivating sacred 
2007 [84] moments 



Grant 2009 Executive coaching 
[79] 

Grant 2012 Solution-focused 



coaching 



Green 2006 Life coaching and 



[33] 



attainment of goals 



Luthans 
2008 [55] 

Luthans 
2010 study 
[72] 



Online well-being 
program (PsyCap) 

PsyCap training 



15, 3w 

6, 8-1 Ow 

1, Id 
10, lOw 



Hurley 2012 Savoring the moment 14, 2w 
[61] 

King 2001 Writing about best 4, 4d 

[66] possible selves 

Kremers Self-management 6, 6w 

2006 [57] positive group course 



Layous2012 Best possible selves 4, 4w 

[75] exercise 

Lichter 1980 Rehearsal of positive 14, 2w 

study 2 [80] statements 



2, 2w 



1, 2 h 



3, 3d 



Lyubomirsky Thinking about 

2006 study 2 positive life 

[58] experiences 

Lyubomirsky Expressing optimism 8, 8w 

201 1 [67] or gratitude 



44.9 
(10.07) 



Internet, 
magazine 



(22-44) Self-help Internet 



Self- 
selected 



Self- 
selected 



49.8 



Group Organization Self- 



and 

individua 



20.5 (5.4) Self-help University 



42.7 (I8- 
60) 



19.5(2.06) Group/ University 
Self-help 

21 (18-42) Self-help University 

64.3 (7) 



19.1 (1.8) Self-help University 
Group 



U 

(students) 
32.2 



Individual University 
Self-help University 



21.1 (2.66) Group University 



19.5(2.6) Self-help University 



19.7(18- Self-help University 
46) 



selected 

Self- 
selected 



Group Community Self- 
selected 



Group Community Self- 
selected 



Self- 
selected 



Self- 
selected 



None 

None 

None 
None 



Not self- None 
selected 

Not self- None 
selected 



Single and lonely 



Not self- None 
selected 

Not self- None 
selected 



None 



Not self- None 
selected 

Not self- None 
selected 



None 



TAU 



Ne=559 
Nc=63 



Ne=35 
Nc=38 



Waiting list Ne=21 
Nc=20 



TAU 



Ne=117 
Nc=108 



Waiting list Ne=25 
Nc=25 



I lo 



Ne=94 



intervention Nc=99 

Placebo Ne=19 
Nc=16 

No Ne=46 
intervention Nc=73 



Placebo 



Ne=80 
Nc=37 



Waiting list Ne=25 
Nc=23 

Placebo Ne=187 
Nc=177 

Placebo Ne=153 
Nc=89) 

No Ne=26 
intervention Nc=36 



Placebo 



14.6% 
9.5% 
T: 12.0 

18% 



0% (? nr) 

1 0.7% 
1 0.7% 
T: 1 0.7% 



37.7% 
39.6% 
T: 38.7 1 ; 

0% 



1 7.0% 
7.6% 
T: 16.2% 

? 



0% (? nr) 

6.0% 
4.8% 
T: 5.5% 



0% 



Ne=218 T: 10.1% 
Nc=101 



PWB: AHI 
DEP: CES- 
D 



SWB: SWLS - 

PWB: 

RPWB 

DEP: 
DASS-21 

SWB: PA 

SWB: 
SWLS, PA 
PWB: 

RPWB, SHS 

SWB: PA 
DEP: BDI 

SWB: PA 

SWB: SPF- 6 m 
IL 

SWB: PA 
PWB: NS 

SWB: AF1 - 
DEP: BDI 

PWB: PCQ - 



PCQ 



SWB: 
SWLS, PA 

SWB: PLA, 6 m 
SWLS, SHS 

(2) 



° § 

CL C 

n 2 

* §: 

O 5 

3 NJ 

o 



CO 

o 



Table 2 Characteristics of randomized controlled trials examining the effects of positive psychology interventions (Continued) 



Martinez 
2010 [68] 



Mitchell 
2009 [69] 



Practising gratitude by 14, 2w 

counting one's 

blessings 



Online intervention 
Use your strenghts in 
a new way 



Peters 2010 
[70] 

Quoidbach 
2009 [59] 

Schueller 
2012 [63] 



Seligman 
2005 [30] 



Seligman 
2006 study 1 
[51] 

Seligman 
2006 study 2 
[51] 



Positive future 
thinking 

Projecting a positive 
self in the future 

Package of 2, 4 or 6 
positive psychology 
exercises (active- 
constructive 
responding, gratitude 
visit, life summary, 
three good things, 
savoring, strengths) 

Strenghts excercises 
(2), gratitude (1), 
positive thinking (2) 

Group positive 
psychotherapy 

Individual positive 
psychotherapy 



Shapira 2010 Three good things, 



[55]; 
Mongrain 
2011 [53]; 
Sergeant 

2011 [54]; 
Mongrain 

2012 [52] 



signature strengths, 

self-compassion, 

optimism, 

compassionate action, 
gratitude intervention 



3, 3w 



Page 2012 Working for Wellness 6, 6w 
[62] Program 



1, Id 



14, 2w 



14, 2w 28, 
4w 42, 6w 



7, 1w 



6, 6w 



14, 12w 



20.7(1.5) Self-help University 



37 (18-62) Self-help Internet 



Not self- 
selected 



Self- 
selected 



39.7(10.0) Group 



Organization Self- 
selected 



29.7 (2 
50) 



Self-help University 
32.5 Self-help University 

42.4(12.1) Self-help Internet 



64% 

between5- 
54 

U 

(students) 
U (adults) 



Self-help Internet 



Group University 



Individual Referral/ 
hospital 



34(11.8) Self-help Internet 



Not self- 
selected 

Not self- 
selected 

Self- 
selected 



Self- 
selected 

Self- 
selected 

Self- 
selected 



Self- 
selected 



None 



None 



None 



None 



None 



None 



Placebo 



Ne=41 
Nc=34 



Placebo Ne=48 
Nc=54 



No Ne=13 
intervention Nc=10 



Placebo 
No 

intervention 
No 

intervention 



Ne=44 
Nc=38 

Ne=15 
Nc=57 

Ne=457 
Nc=204 



None Placebo 



Mild to moderate No 

depressive symptoms intervention 
(BDI 10-24) 

Clinical diagnosis of MDD TAU 



Ne=341 
Nc=70 



Ne=14 
Nc=20 



Ne=11 
Nc=9 



None 



Placebo Ne=804 
Nc=138 



34.0% 


SWB: PA, 




GA (self- 




report and 




observed) 


64.6% 


SWB: PWI- 


57.4% 


A, SWLS, 


T: 60.8% 


PA PWB: 




OTH DEP: 




DASS-21 


c;p 1 oa 

JO, I 70 


JVVD. 


66.7% 


SWLS, PA 


T: 62.3% 


PWB: 




SPWB 


0% 


SWB: PA 


T: 49.5% 


SWB: SHS 




(2) 


54.7% 


DEP: CES- 


42.5% 


D 


T: 55.4% 




\ . ZO.O70 


D\A/R- CUI 
rVVD. 3nl 




npp- TFC; 
Ucr. L-Lo- 




u 


26.3% 


SWB: SWLS 


4.8% 


DEP: BDI 


I . I J.U70 




1 5.4% 


SWB: SWLS 


40.0% 


PWB: PPTI 


T: 28.6% 


DEP: 




HRSD, 




ZSRS 


75% 


PWB: SHI 




DEP: CES- 




D 



3 m 



6 month 



6 m 



(in study), 12 m 



(in study), 6 m 



Table 2 Characteristics of randomized controlled trials examining the effects of positive psychology interventions (Continued) 



Sheldon 
2002 [32] 


Goal-training program 


2, 2w 


U 

(students) 


Group 


University 


Not self- 
selected 


None 


Placebo 


Ne=36 
Nc=42 


T: 13.3% 


SWB: PA 

PWB: 

RPWB 


Sheldon 
2006 [34] 


Gratitude or 
visualizing positive self 


14, 2w 


U 

(students) 


Self-help 


University 


Not self- 
selected 


None 


Placebo 


Ne=44 
Nc=24 


T: 6.0% 


SWB: PA 


Spence 2007 
[81] 


Life coaching and 
attainment of goals 


10, 10w 


38.6 


Individual 


Community 


Self- 
selected 


None 


Waiting list 


Ne=20 
Nc=17 


4.8% 
1 5.0% 
T: 9.8% 


SWB: 
SWLS, PA 
PWB: 
RPWB 


Wing 2006 
[71] 


Positive writing 


3, 3d 


40.3 
(18-79) 


Self-help 


Community 


Self- 
selected 


None 


Placebo 


Ne=58 
Nc=55 


6.3% 


SWB: SWLS - 



Abbreviations. U = Unknown; Ne = Number of subjects in experimental group; Nc = Number of subjects in control group; T = Total; nr = Not reported; MDD = Major Depressive Disorder; AD = Anxiety Disorder; GAD = 
Generalized Anxiety Disorder; AHI = Authentic Happiness Inventory; EASQ = Expanded Attributional Style Questionnaire; GFI = Groningen Frailty Indicator; SWLS = Satisfaction with Life Scales; PA = Positive Affect; SHS 
= State Hope Scale; PIL = Purpose in Life Test; CES-D = Center for Epidemiological Studies Depression Scale; SQ = Kellner's Symptom Questionnaire; CID = Clinical Interview for Depression; RPWB = Ryff's Scales of 
Psychological Well-being; MHC-SF = Mental Health Continuum-Short Form; HS = Hope Scale; BDI = Beck Depression Inventory; SPF-IL = Social Production Function-Index Level Scale; MS = Mastery Scale; AF-1 = 
Affectometer 1; PCQ = PsyCap Questionnaire; PLA = Pleasant Affect; SHS(2) = Subjective Happiness Scale; GA = Global Appraisals of subjective well-being; PWI-A = Personal Well-being Index for Adults; OTH = 
Orientations To Happiness; DASS-21 = Depression, Anxiety and Stress Scales; WB6 = 6 well-being questions; SHI = Steen Happiness Index; PPTI = Positive Psychotherapy Inventory; HRSD = Hamilton Rating Scale for 
Depression; ZSRS = Zung Self-Rating Scale; LSI-A = Life Satisfaction Index-A; GDS = Geriatric Depression Scale; GSHS = Goal-Specific Hope Scale; NS = Needs Satisfaction. 
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[29,51,82,83], in three studies in an organization [62,78,79] 
and six studies recruited through the internet [30,52- 
55,63,69,74,84]. Twenty-eight studies measured subjective 
well-being, 20 studied psychological well-being and 14 
studied depressive symptoms. Half of the studies (20) 
were aimed at adult populations [29,30,33,51-56,62,63,65, 
69,71,73,74,76,78,79,81-84]. A substantial number of studies 
(17) were aimed at college students [29,32,34,51,58-61,64, 
66-68,70,72,75,80,85] and two studies were aimed at older 
subjects [57,77]. In most studies (26) the PPI was delivered 
in the form of self-help [29,30,34,52-56,58,59,61,63-71,73- 
75,77,78,80,84,85]. Eight studies used group PPIs [32,33,51, 
57,60,62,72,76] and five used individual PPIs [51,79,81-83]. In- 
tensity varied considerably across studies, ranging from a short 
one-day exercise [70] and a two-week self-help intervention 
[65] to intensive therapy [51,82,83] and coaching [33,81]. 

Post-test effects 

The random effect model showed that the PPIs were ef- 
fective for all three outcomes. Results are presented in 
Table 3. The effect sizes of the individual studies at post- 
test are plotted in Figures 2, 3 and 4. 

A composite moderate and statistically significant 
effect size (Cohen's d) was observed for subjective well- 
being d = 0.34 (95% CI [0.22, 0.45], p<.01). For psycho- 
logical well-being, Cohen's d was 0.20 (95% CI [0.09, 
0.30], p<.01) and for depression d = 0.23 (95% CI [0.09, 
0.38], p<.01), which can be considered as small. 

Heterogeneity was moderate for subjective well-being 
(I 2 = 49.5%) and depression (I 2 = 47.0%), and low for 
psychological well-being (I 2 = 29.0%). Effect sizes ranged 
from -0.09 [66] to 1.30 [64] for subjective well-being, 
-0.06 [78] to 2.4 [83] for psychological well-being and 
-0.17 [69] to 1.75 [83] for depression. 

Removing outliers reduced effect sizes for all three out- 
comes: 0.26 (95% CI [0.18, 0.33], Z=6.43, p<.01) for sub- 
jective well-being (Burton & King, 2004 and Peters et al, 
2010 removed) [64,70], 0.17 (95% CI [0.09, 0.25], Z=4.18, 
p<.01) for psychological well-being (Fava et al. (2005) 
removed) [83] and 0.18 (95% CI [0.07, 0.28], Z=3.33, 
p<.01) for depression (Fava, 2005 and Seligman, 2006 
study 2, removed) [51,83]. Removing the outliers reduced 
heterogeneity substantially (to a non-significant level). 

Follow-up effects 

Ten studies examined follow-up effects after at least three 
months and up to 12 months (Table 3). For the purposes 
of interpretation, we used only those studies examining 
effects from three to six months (short-term follow-up), 
thus excluding Fava et al. (2005) [83] which had a follow- 
up at one year. The random-effects model demonstrated 
small but significant effects in comparison with the con- 
trol groups for subjective well-being (Cohen's d 0.22, 95% 
CI [0.05, 0.38], p<.01) and for psychological well-being 



(0.16, 95% CI [0.02, 0.30], p = .03). The effect was not 
significant for depression (0.17, 95% CI [-0.06, 0.39], 
p = .15). Heterogeneity was low for subjective well-being 
(I 2 = 1.1%) and psychological well-being (I 2 = 26.0%), and 
high for depression (I 2 = 63.9%). 

Subgroup analyses 

Subgroup analyses are presented in Table 4. We looked 
at self-selection, duration of the intervention, type of 
intervention, recruitment method, application of inclu- 
sion criteria related to certain psychosocial problems, 
and quality rating. 

For depression, five out of six subgroups of studies 
resulted in significantly higher effect sizes. Higher effect 
sizes were found for 1) interventions of a longer dur- 
ation (only in the meta regression analysis), 2) individual 
interventions, 3) studies involving referral from a health 
care practitioner or hospital, 4) studies which applied in- 
clusion criteria based on psychosocial problems and 5) 
lower quality studies. For subjective well-being and psy- 
chological well-being, there were no significant differ- 
ences between subgroups, although for the latter there 
was a recognizable trend in the same direction and on 
the same moderators, except for quality rating. 

Twenty-six out of 39 studies were self-help interven- 
tions for which we conducted a separate subgroup 
analysis. However, there was little diversity within the 
self-help subgroup: only six studies examined intensive 
self-help for longer than four weeks, self-help was offered 
to people with specific psychosocial problems in only 
one study and more than half of the self-help studies 
(n=14) recruited their participants via university. Conse- 
quently, there were no significant differences between 
subgroups for self-help interventions. 

Publication bias 

Indications for publication bias were found for all out- 
come measures, but to a lesser extent for subjective 
well-being. Funnel plots were asymmetrically distributed 
in such a way that the smaller studies often showed the 
more positive results (in other words, there is a certain 
lack of small insignificant studies). Orwin's fail-safe 
numbers based on a criterium effect size of 0.10 for sub- 
jective well-being (59), psychological well-being (16) and 
depression (13) were lower than required (respectively 
150, 110 and 80). Egger's regression intercept also sug- 
gests that publication bias exists for psychological 
well-being (intercept=1.18, t=2.26, df=18, p=.04) and de- 
pression (intercept=1.45, t=2.26, df=12, p=.03), but not 
for subjective well-being (intercept=1.20, t=1.55, df=26, 
p=0.13). The mean effect sizes of psychological well- 
being and depression were therefore recalculated by im- 
puting missing studies using the Trim and Fill method. 
For psychological well-being, three studies were imputed 



Table 3 Main effects 



Outcome measures 



Studies 



Cohen's d (95% CI) Heterogeneity 



Test for overall effect 



Post-test 

Subjective well-being 28 

Psychological well-being 20 

Depression 14 
Follow-up 

Subjective well-being 6 

Psychological well-being 6 

Depression 5 



Ne=1449 Nc=1265 [29,32-34,51,56-59,61,62,64,66-71,73,75,77,79-81,84,85] 0.34 (0.22 - 0.45) 

Ne=25 1 1 Nc=977 [29,30,32,33,5 1 -55,60,62,65,69,74-77,8 1 -84] 0.20 (0.09 - 0.30) 

Ne=2435 Nc=760 [30,51-55,61,63,69,74,76,80,82,83] 0.23 (0.09 - 0.38) 

Ne=329 Nc=298 [51,57,62,67,69,77] 0.22 (0.05 - 0.38) 

Ne=1 830 Nc=41 7 [30,52-55,62,69,74,77] 0.1 6 (0.02 - 0.30) 

Ne=1765 Nc=343 [30,51-55,69,74] 0.1 7 (-0.06 - 0.39) 



Q=53.5, df=27, T 2 =0.04 (p<.01 ); l 2 =49.5% Z=5.82 (p<.01 ) 

Q=26.8, df=19, T 2 =0.01 (p=0.1 1); l 2 =29.0% Z=3.65 (p<.01) 

Q=24.5, df=13, T 2 =0.03 (p=0.03); l 2 =47.0% Z=3.21 (p<.01) 

Q=5.05, df=5, T 2 =0.00 (p=0.41); l 2 =1.1% Z=2.61 (p<.01) 

Q=6.8, df=5, T 2 =0.01 (p=0.24); l 2 =26.0% Z=2.20 (p=.03) 

Q=1 1.1, df=4,T 2 =0.04 (p=0.03); l 2 =63.9% Z=1.44 (p=.15) 



n = Number of studies, N = Number of subjects, Ne = Number of subjects in experimental group; Nc = Number of subjects in control group. 
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Subjective well-being 



Study name 


Statistics 


for each 


study 




Std 


diff 


Upper 


Lower 






in means 


limit 


limit 


Z-Value 


p-Value 


Boehm 2011 


0,13 


0,41 


-0,15 


0,91 


0,36 


Buchanan 2010 


0,62 


1,16 


0,08 


2,27 


0,02 


Burton 2004 


1,30 


1,75 


0,84 


5,59 


0,00 


Emmons 2006 study 1 


0,23 


0,57 


-0,12 


1,29 


0,20 


Emmons 2006 study 3 


0,53 


1,02 


0,03 


2,08 


0,04 


Frieswijk 2005 


0,26 


0,57 


-0,04 


1,68 


0,09 


Goldstein 2007 


0,06 


0,52 


-0,40 


0,26 


0,80 


Grant 2009 


0,58 


1,20 


-0,05 


1,80 


0,07 


Grant 2012 


0,39 


0,65 


0,13 


2,89 


0,00 


Green 2006 


0,93 


1,52 


0,34 


3,08 


0,00 


Hurley 2012 


0,14 


0,42 


-0,14 


0,99 


0,32 


King 2001 


-0,09 


0,58 


-0,75 


-0,26 


0,80 


Kremers 2006 


0,44 


0,81 


0,07 


2,31 


0,02 


Layous 2012 


0,37 


0,76 


-0,02 


1,84 


0,07 


Lichter 1 980 study 2 


0,38 


0,95 


-0,19 


1,30 


0,19 


Lyubomirsky 2006 study 2 


0,02 


0,53 


-0,48 


0,08 


0,94 


Lyubomirsky 201 1 


0,25 


0,49 


0,01 


2,07 


0,04 


Martinez 2010 


0,16 


0,42 


-0,11 


1,16 


0,24 


Mitchell 2009 


0,05 


0,44 


-0,34 


0,27 


0,79 


Page 2012 


0,69 


1,54 


-0,16 


1,59 


0,11 


Peters 2010 


1,13 


1,60 


0,66 


4,73 


0,00 


Quoidbach 2009 


0,61 


1,19 


0,03 


2,07 


0,04 


Seligman 2006 study 1 


-0,02 


0,67 


-0,70 


-0,05 


0,96 


Seligman 2006 study 2 


0,47 


1,36 


-0,43 


1,02 


0,31 


Sheldon 2002 


0,00 


0,45 


-0,45 


0,00 


1,00 


Sheldon 2006 


0,25 


0,76 


-0,26 


0,96 


0,34 


Spence 2007 


0,20 


0,84 


-0,45 


0,59 


0,56 


Wing 2006 


0,16 


0,53 


-0,21 


0,85 


0,39 




0,34 


0,45 


0,22 


5,82 


0,00 



Std diff in means and 95% CI 



-1,00 -0,50 0,00 0,50 1,00 

Favours Control group Favours PPI 



Meta Analysis 

Figure 2 Post-test effects of positive psychology interventions on subjective well-being. The square boxes show effect size and sample 
size (the larger the box, the larger the sample size) in each study, and the line the 95% confidence interval. The diamond reflects the pooled 
effect size and the width of the 95% confidence interval. 



and the effect size was adjusted to 0.16 (95% CI 0.03- 
0.29). For depression, five studies were imputed and the 
adjusted effect size was 0.16 (95% CI 0.00-0.32). 

Discussion 

Main findings 

This meta-analysis synthesized effectiveness studies on 
positive psychology interventions. Following a systematic 
literature search, 40 articles describing 39 studies were 
included. Results showed that positive psychology inter- 
ventions significantly enhance subjective and psycho- 
logical well-being and reduce depressive symptoms. 
Effect sizes were in the small to moderate range. The 
mean effect size on subjective well-being was 0.34, 0.20 



on psychological well-being, and 0.23 on depression. Ef- 
fect sizes varied a great deal between studies, ranging 
from below 0 (indicating a negative effect) to 2.4 (indi- 
cating a very large effect). Moreover, at follow-up from 
three to six months, small but still significant effects 
were found for subjective well-being and psychological 
well-being, indicating that effects were partly sustained 
over time. These follow-up results should be treated 
with caution because of the small number of studies and 
the high attrition rates at follow-up. 

Remarkably, effect sizes in the current meta-analysis 
are around 0.3 points lower than the effect sizes in the 
meta-analysis by Sin and Lyubomirsky (2009) [37]. We 
included a different set of studies in which the design 
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Psychological well-being 



Study name 


Statistics for each 


study 






Std diff 


Upper 


Lower 








n means 


limit 


limit 


Z-Value 


p-Value 


Ahhntt 9nnQ 
MUUUll *1UU3 


-0 06 


0 48 


-0 60 


-0 22 


0 83 


u_>l IgcIVgI Is £UUO 
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Figure 3 Post-test effects of positive psychology interventions on psychological well-being. The square boxes show effect size and sample 
size (the larger the box, the larger the sample size) in each study, and the line the 95% confidence interval. The diamond reflects the pooled 
effect size and the width of the 95% confidence interval. 
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Figure 4 Post-test effects of positive psychology interventions on depressive symptoms. The square boxes show effect size and sample 
size (the larger the box, the larger the sample size) in each study, and the line the 95% confidence interval. The diamond reflects the pooled 
effect size and the width of the 95% confidence interval. 
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Table 4 Moderator effects: subgroup analysis (post-test) 



Outcome measure 


Criteria 


Subgroup (study) 




p 


Cohen's d (95% CI) 


Test for subgroup differences 
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15 
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0=0.64, df=1 (p=.43) 
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13 
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1 / 
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Table 4 Moderator effects: subgroup analysis (post-test) (Continued) 





Individual 


4 


0.88 (0.29 - 1 .47)** 




Recruitment 


Community 
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0.48 (-0.23 - 1.18)ns 


Q=15.76, df=4 (p<.01) 




Internet 


5 


0.1 1 (-0.02 - 0.23)ns 






Referra /hospita 


3 


1.14 (0.55 - 1.73)*** 






University 


3 


0.41 (0.17 - 0.65)** 






Organization 


2 


0.22 (-0.18 - 0.63)ns 




Psychosocial problems 


Specific psychosocial problems 


5 


0.78 (0.35 - 1.21)*** 


Q=7.65, df=1 (p=.01) 




None 


9 


0.16 (0.05 - 0.27)** 




Quality rating 


Low (1-2) 


/ 


0.47 (0.26 - 0.67)*** 


Q=10.14, df=2 (p=.01) 




Medium (3-4) 


6 


0.15 (0.00 - 0.30)* 


Slope=-0.10, Z=-2.26 (p 




High (5-6) 


1 


-0.17 (-0.56 - 0.22)ns 





* p<0.05; ** p<0.01; *** p<0.001; ns non-significant, 
n = Number of studies. 



quality was assured using randomized controlled trials 
only. Effectiveness research in psychotherapy shows that 
effect sizes are relatively small in high-quality studies 
compared with low-quality studies [35] and this might 
also be true for positive psychology interventions. In 
addition, we applied stricter inclusion criteria than those 
used by Sin and Lyubomirsky (2009) and therefore did 
not include studies on any related areas such as mindful- 
ness and life review therapy. These types of interven- 
tions stem from long-standing independent research 
traditions for which effectiveness has already been estab- 
lished in several meta-analyses [40,41]. Also, the most 
recent studies were included. This might explain the 
overestimation of effect sizes in the meta-analysis by Sin 
and Lyubomirsky (2009). 

Several characteristics of the study moderated the ef- 
fect on depressive symptoms. Larger effects were found 
in interventions with a longer duration, in individual 
interventions (compared with self-help), when the inter- 
ventions were offered to people with certain psycho- 
social problems and when recruitment was carried out 
via referral from a health care professional or hospital. 
Quality rating also moderated the effect on depression: 
the higher the quality, the smaller the effect. Interest- 
ingly, these characteristics did not significantly moderate 
subjective well-being and psychological well-being. How- 
ever, there was a trend in the moderation of psycho- 
logical well-being that was the same as that observed in 
the studies which included depression as an outcome. In 
general, effectiveness was increased when interventions 
were offered over a longer period, face-to-face on an in- 
dividual basis in people experiencing psychosocial pro- 
blems and when participants were recruited via the 
health care system. 

Although it is clear that more intensive and face-to- 
face interventions generate larger effects, the effects of 



short-term self-help interventions are small but signifi- 
cant. From a public health perspective, self-help inter- 
ventions can serve as cost-effective mental health 
promotion tools to reach large target groups which may 
not otherwise be reached [86-88]. Even interventions 
presenting small effect sizes can in theory have a major 
impact on populations' well-being when many people 
are reached [89]. The majority of positive psychology 
interventions (in our study 26 out of 39 studies) are 
already delivered in a self-help format, sometimes in 
conjunction with face-to-face instruction and support. 
Apparently, self-help suits the goals of positive psych- 
ology very well and it would be very interesting to learn 
more about how to improve the effectiveness of PPI self- 
help interventions. However, a separate subgroup ana- 
lysis on the self-help subgroup revealed no significant 
differences in the present meta-analysis. There was very 
little variation in the subgroups as regards population, 
duration of the intervention and recruitment method. 
As a result, this analysis does not give firm indications 
on how to improve the effectiveness of self-help inter- 
ventions. It is possible that self-help could be enhanced 
by offering interventions to people with specific psycho- 
social problems, increasing the intensity of the interven- 
tion and embedding the interventions in the health care 
system. However, more studies in diverse populations, 
settings and with varying intensity are needed before we 
can begin to derive recommendations from this type 
of meta-analysis. Other research gives several additional 
indications on how to boost the efficacy of self-help inter- 
ventions. Adherence tends to be quite low in self-help 
interventions [90,91] and therefore, enhancing adherence 
could be a major factor in improving effectiveness. Self- 
help often takes a 'one size fits all' approach, which may 
not be appropriate for a large group of people who will, as 
a consequence, not fully adhere to the intervention. 
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Personalization and tailoring self-help interventions to in- 
dividual needs [92] as well interactive support [93] might 
contribute to increased adherence and likewise improved 
effectiveness of (internet) self-help interventions. 

Study limitations 

This study has several limitations. First, the quality of the 
studies was not high, and no study met all of our quality 
criteria. For example, the randomization procedure was 
unclear in many studies. Also, most studies conducted 
completers-only analysis, as opposed to intention-to-treat 
analysis. This could have seriously biased the results [35]. 
However, the low quality of the studies could have been 
overstated as the criteria were scored conservatively: we 
gave a negative score when a criterion was not reported. 
Even so, more high-quality randomized-controlled trials 
are needed to enable more robust conclusions about the 
effects of PPIs. Second, different types of interventions are 
lumped together as positive psychology interventions, des- 
pite the strict inclusion criteria we applied. As expected, 
we found a rather high level of heterogeneity. In the fu- 
ture, it might be wise and meaningful to conduct meta- 
analyses that are restricted to specific types of interven- 
tions, for example gratitude interventions, strengths-based 
interventions and well-being therapy, just as has already 
been carried out with, for example, mindfulness and life 
review. In the present meta-analysis, studies on these spe- 
cific interventions were too small and too diverse to allow 
for a subgroup-analysis. Third, the exclusion of non peer- 
reviewed articles and grey literature could have led to bias, 
and possibly also to the publication bias we found in our 
study. Fourth, although we included a relatively large 
number of studies in the meta-analysis, the number 
of studies in some subgroups was still small. Again, more 
randomized-controlled trials are needed to draw firmer 
conclusions. Sixth, the study of positive education is 
an emerging field in positive psychology [94-98] but 
school-based interventions were excluded from our meta- 
analysis due to the strict application of the inclusion cri- 
teria (only studies with randomization at individual level 
were included). 

Conclusion 

This meta-analysis demonstrates that positive psych- 
ology interventions can be effective in the enhancement 
of subjective and psychological well-being and may help 
to reduce depressive symptom levels. Results indicate 
that the effects are partly sustained at short-term fol- 
low-up. Although effect sizes are smaller in our meta- 
analysis, these results can be seen as a confirmation of 
the earlier meta-analysis by Sin and Lyubomirsky (2009). 
Interpretation of our findings should take account of the 
limitations discussed above and the indications for publi- 
cation bias. 



Implications for practice 

In mental health care PPIs can be used in conjunction with 
problem-based preventive interventions and treatment. 
This combination of interventions might be appropriate 
when clients are in remission; positive psychology interven- 
tions may then be used to strengthen psychological and so- 
cial recourses, build up resilience and prepare for normal 
life again. On the basis of the moderator analysis, we would 
recommend the delivery of interventions over a longer 
period (at least four weeks and preferably eight weeks or 
longer) and on an individual basis. Practitioners can tailor 
their treatment strategy to the needs and preferences of 
a client and can use positive psychology exercises in com- 
bination with other evidence-based interventions that have 
a positive approach and aim to enhance well-being, such 
as mindfulness interventions [40], Acceptance and Com- 
mitment Therapy [7,99], forgiveness interventions [42], 
behavioral-activation [100] and reminiscence [41,101]. 

In the context of public health, positive psychology 
interventions can be used as preventive, easily accessible 
and non-stigmatizing tools. They can potentially be used 
in two ways: 1) in mental health promotion (e.g. leaflets 
distributed for free at community centers, (mental) health 
internet portals containing psycho-education), and 2) as a 
first step in a stepped care approach. In the stepped care 
model, clients start with a low-intensity intervention if 
possible, preferably a self-directed intervention. These 
interventions can be either guided by a professional or un- 
guided, and are increasingly delivered over the internet. 
Clinical outcomes can be monitored and people can be 
provided with more intensive forms of treatment, or re- 
ferred to specialized care, if the first-step intervention does 
not result in the desired outcome [102]. 

Recommendations for research 

Regarding the research agenda, there is a need for more 
high-quality studies, and more studies in diverse (clin- 
ical) populations and diverse intervention formats to 
know what works for whom. Standards for reporting 
studies should also be given more attention, for example 
by reporting randomized controlled trials according to 
the CONSORT statement [103]. In addition, we encour- 
age researchers to publish in peer-reviewed journals, 
even when the sample sizes are small or when there is a 
null finding of no effect, as this is likely to reduce the 
publication bias in positive psychology. Furthermore, 
most studies are conducted in North America. There- 
fore, replications are needed in other countries and cul- 
tures because some positive psychology concepts may 
require adaptation to other cultures and outlooks (e.g. 
see Martinez et al, 2010) [68]. Last but not least, we 
strongly recommend conducting cost-effectiveness stud- 
ies aiming to establish the societal and public health im- 
pact of positive psychology interventions. This type of 



Bolier et al. BMC Public Health 201 3, 13:1 1 9 
http://www.biomedcentral.com/1471-2458/13/119 



Page 18 of 20 



information is likely to help policy makers decide 
whether positive psychology interventions offer good 
value for money and should therefore be placed on the 
mental health agenda for the 21 st century. 
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